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1. INTRODUCTION 

More systematic studies are needed for a better understanding of how multispectral data properties such as 
ground sample distance (GSD) and spatial resolution, extent and shape of spectral bands, signal-to-noise ratio 
(SNR), data quantization, and band-to-band registration affect performance of the remote sensing imagery in real- 
world applications. However, because the munber of available multispectral data sources is still limited, parametric 
studies with varying image properties are difficult to conduct In the case of panchromatic imagery, the amoimt of 
data collected at various scales and other parameters facilitated development of the General Image Quality Equation 
(GIQE) that allows predicting values of GSD, edge response, and SNR necessary to detect and identify objects of 
interest (Leachtenauer et al., 1997). To support systematic studies of multispectral data requirements, the 
Applications Research Toolbox (ART) has been developed at NASA's Stennis Space Center. The ART software 
provides the capability to generate simulated multispectral images with predefined properties from data acquired by 
existing sensors with higher spatial and spectral resolution. Multiple datasets simulated with key data characteristics 
varied parametrically can be then evaluated by potential end-users for utility in real-world applications. 

Spectral band synthesis is a key step in the process of creating a simulated multispectral image from 
hyperspeetral data. In this step, narrow hyperspeetral bands are combined into broader multispectral bands. Such an 
approach has been used quite often, but to the best of our knowledge accuracy of the band synthesis simulations has 
not been evaluated thus far. Therefore, the main goal of this paper is to provide validation of the spectral band 
synthesis algorithm used in the ART software. The next section contains a description of the algorithm and an 
exan^le of its application. Using spectral responses of AVIRIS, Hyperion, ALI, and ETM+, the following section 
shows how the synthesized spectral bands compare with actual bands, and it presents an evaluation of the simulation 
accuracy based on results of MODTRAN modeling. In the final sections of the paper, simulated images are 
conqiared with data acquired by actual satellite sensors. First, a Landsat 7 ETM+ image is simulated using an 
AVIRIS hyperspeetral data cube. Then, two datasets collected with the Hyperion instrument from the EO-1 satellite 
are used to simulate multispectral images from the ALI and ETM+ sensors. 

2. SPECTRAL BAND SYNTHESIS ALGORITHM 

Equations governing the spectral band synthesis process are shown here for completeness of the 
presentation. Although the band synthesis process has been proposed and applied previously, it is not clear if the 
applied formulae were the same as in the exurent work (Anderson et al., 2000). Band synthesis, applying an 
algorithm that compares more closely to the one presented here, was conducted during a cross-calibration of a 
satellite multispectral instrument with AVIRIS (Green and Shimada, 1997), as well as in simulations of future 
sensors (Esposito et al., 1999). In all the methods, each band of a multispectral image is simulated by a weighted 
sum of the hyperspeetral image bands. Differences between the methods are in the ways the weights are determined. 
In the current approach, calculation of the weights is based on finding the best approximation of a multispectral 
response by a linear combination of the hyperspeetral responses. This method is consistent with the goal of the most- 
accurate modeling of a sensor with a predefined spectral response. 
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Consider a multispectral instrument (MSI) with bands and a hyperspectral instrument (HSI) with Nhsi 
bands, ^ectral response of the i* MSI band is defined at n wavelengths Spectral response of the f' HSI 
band Rj is also known for these wavelengths. The linear combination coefficients Cy are derived by solving in the 
least-squares sense the following set of band-synthesis equations: 

for A = l,...,n; i = 

7=1 

Spectral responses of existing hyperspectral instruments such as AVIRIS and Hyperion are accurately 
approximated with Gaussian functions. For the HSI bands witii the Gaussian shape and full width at half-maximum 
Ay, the coefficients Cy are used in the following weighted-sum formulae to calculate (for each pixel) spectral radiance 
of the synthesized multispectral image bands from the hyperspectral radiances 
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An example of the band synthesis is shown in Figure 1 for the case of Landsat 7 ETM+ Band 1 simulation 
from AVIRIS 1999 data. The figure also illustrates that although the synthesized bands and the actual bands closely 
overlap, some artifacts such as ripples at band plateaus, shoulders at band edges, and negative values outside bands 
do occur. Evaluation of effects of those artifacts on simulation results is presented in the following section. 


Landsat? ; Band 1 (Blue) 



Figure 1. Comparison of actual and simulated spectral response of Landsat 7 ETM+ band 1: 
hyperspectral Components used in the band synthesis are shown as dotted lines. 


3, MODTRAN MODELING 


To evaluate effects of differences between actual and synthesized spectral bands, extensive atmospheric 
radiative-transfer modeling was undertaken using the MODTRAN4 software (Berk at al, 1998). The calculations 
included the correlated-x option and the Isaacs approximation for the multiple scattering. About 30,000 MODTRAiN 
calculations were conducted for each sensor: AVIRIS, Hyperion, ALI, and ETM+. The calculations were based on 
1,287 surface reflectance spectra selected from the ASTER library, which comprises spectra collected at Johns 
Hopkins University, the NASA Jet Propulsion Laboratory (JPL), and U.S. Geological Survey (USGS) (Hook, 1999), 
as well as from the USGS Spectroscopy Lab collection (Clark, 1993). The selected spectra were measured mainly 
for minerals, but vegetation, soils, and man-made materials such as concrete were also included. For each 
reflectance spectrum, 24 MODTRAN calculations were conducted, i.e., for 6 atmospheric models combined with 4 
aerosol conditions. The atmospheric models spanned a wide range of climates and seasons: 



• tropical at 30°N on June 22 

• tropical at 30°N on Dec. 22 

• mid-latitude summer at 45°N on Jime 22 

The aerosol models were diverse as well: 

• rural, VIS = 23 km 

• rural, VIS = 5 km 


• mid-latitude winter at 45°N on Dec. 22 

• sub-arctic sinnmer at 60°N on Jime 22 

• sub-arctic winter at 60°N on Dec. 22 

• urban, VIS = 5 km 

• tropospheric, VIS = 50 km 


For all the sensors (even AVIRIS), the calculations were performed with the nadir viewing geometry from space 
with sensor altitude set to 100 km and groimd at sea level. Solar illumination was specified by longitude of 0° and 
acquisition time at 10:00 UTC. To generate in-band mean spectral radiance values, convolution of the calculated 
atmospheric radiance spectra and the instrument spectral response fimctions was conducted internally within 
MODTRAN. The same convolution procedure was applied for the multispectral sensors, ALI and ETM+, and the 
hyperspectral sensors, AVIRIS and Hyperion. The calculations were based on spectral response fimctions obtained 
from existing data on spectral calibration of the instrumente. Results of the MODTRAN calculations for the 
hyperspectral sensors were fiirther processed with the band synthesis algorithm to simulate response of the 
multispectral sensors. Radiance values generated by the band synthesis were compared with those created directly in 
the MODTRAN modeling for the same surface refiectance and atmospheric conditions. 

Synthesis of Landsat 7 ETM+ band data has been conducted from the AVIRIS and EO-1 Hyperion 
hyperspectral bands. The Hyperion bands were also used to synthesize the EO-1 ALI band data. Results of the band 
synthesis for all three cases are shown in Figure 2. In this figure, the graphs comparing the actual and synthesized 
spectral responses are set against scatter plots created from the MODTRAN generated data. Despite the artifacts 
occurring in the synthesized spectral responses, almost all the scatter plots display very high correlation between 
radiance values simulated from hyperspectral data by band synthesis and those generated directly in the MODTRAN 
modeling. Although the figure shows only data for bands 2 (green) and 4 (NIR), results for the other bands, not 
shown here due to limited space, are very similar to the best ones presented. The least accurate band synthesis 
occurs for the ETM+ band 2 simulations from Hyperion data; dispersion of points on the scatter plot suggests the 
possibility of 10 to 15% radiometric errors. This is in clear contrast to the very accurate simulations of the same 
ETM+ band from the 1999 AVIRIS data, and it is an illustration of possible effects of spectral aliasing. Although 
synthesis of the ALI band 4 is more challenging because of its narrow width, the respective scatter plot proves that 
the simulation is still quite accurate. 


4. IMAGES 


The AVIRIS image used for the band synthesis experiment presented in this paper was obtained from the 
JPL archive as a radiometrically calibrated, but not geometrically corrected, image product. The image was acquired 
from the high-altitude platform (ER-2) over a Maryland area at 15:35 UTC on May 11, 2000. GSD of the image was 
estimated to be approximately 18 m. A relatively cloud-free area of 592 x 656 pixels was selected from the AVIRIS 
image for the comparison with the Landsat 7 ETM+ image acquired near coincidentally. The ETM+ image was 
acquired for the Worldwide Reference System (WRS) path 15 and row 33 at 15:38 UTC on the same day as the 
AVIRIS image. The image was obtained from the USGS EROS Data Center (EDC) on level OR and processed in- 
house to level IG using the LPGS-lite software with the following parameters: UTM projection, GSD of 30 m, and 
cubic-convolution resampling. An area of 353 x 372 pixels, having the same extend as the AVIRIS image subset, 
was selected from the Landsat image. 


EO-1 images selected for the presentation v/ere obtained from NASA Goddard Space Flight Center. Both 
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over an Arizona area (WRS path 35, row 38) at 17:42 UTC on March 23, 2001 (day 82). The second pair was 
acquired over a New England area (WRS path 12, row 31) at 15:17 UTC on May 9, 2001 (day 129). Respective 
Landsat 7 ETM+ images were acquired one minute before the EO-1 data. Those Landsat 7 images were obtained 
from the EDC on level OR as well, but they were processed only to level IR using the LPGS-lite software. Areas of 
overlap between the Hyperion, ALI, and ETM+ images were selected from the images. Due to small GSD 
differences between the instruments, pixel sizes of the image subsets are slightly different, for exanqjle, 197 x 6094 
pixels for Hyperion and 201 x 6234 pixels for ALL 
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Figure 2. Conparison of spectral band synthesis results and actual spectral responses for band 2 (top row of the 
upper panel) and band 4 (top row of the lower panel) of the ALI and ETM+ instruments. Scatter plots created from 
the MODTRAN-generated data (bottom rows of bo& panels) show moderate effects of the band synthesis artifacts 
on the simulated images. 
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5. AVIRIS-BASED ETM+ SIMULATIONS 


An image with the Landsat 7 ETM+ bands synthesized from the AVIRIS data is shown in Figure 3 together 
with the actual ETM+ image. Because of the GSD difference, only histograms of the images are compared in Figure 
4. Despite the GSD difference, the histograms of the actual and simulated data still agree. Not only are the shapes of 
the histograms generally the same, but the positions of the peaks closely match. 




Figinre 3. Tme color Landsat 7 ETM+ image of the Laurel, 
Maryland, area (right) and the image synthesized from the 
AVIRIS data (left). The suburban area contains not only 
numerous roads, but also vegetated spaces and a noticeable 
water surface, of which a dark signature is apparent in 
histograms for the infrared bands. 
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Figure 4. Histograms of radiance values for the actual Landsat 7 ETM+ image and for the image simulated by 
spectral band synthesis from the AVIRIS hyperspectral data. 








6. HYPERION-BASED ALI AND ETM+ SIMULATIONS 


EO-1 Hyperion data from Arizona and New England were used to simulate both Landsat 7 ETM+ and EO- 
1 ALI images. Examples of the actual and simulated images are shown in Figure 5 (New England) and Figure 6 
(Arizona). The VNIR images demonstrate very good qualitative agreement between the actual and simulated data. 
Radiance histograms presented in Figure 7 allow for quantitative comparisons of the images. The best agreement is 
achieved for the simulations of bands 2 and 3 of the ALI images. Only small radiometric differences occur for the 
other VNIR bands. While actual ETM+ data in the VNIR bands differ a little more from the Hyperion-derived 
values than the ALI data, shapes of the histograms still match very closely. Hyperion-derived data diverges more 
significantly from the original ALI and ETM+ images in the NIR band 4, but the difference is still quite moderate. 
Decisively, large differences occur solely for the SWIR bands 5 and 7. Although the relative differences are close to 
20-30%, the huge discrepancy observed for band 5 of the ALI image from Arizona seems to be a result of some 
accidental error during ground processing of that image. 



Figure 5. Trae color Landsat 7 ETM+ image of the New England swath (left), full-scale subsets of the ETM+ image 
(center) and its simulation from the EO-1 Hyperion data (right). 


EO-1 Hyperion derived Landsat 7 ETM+ bands (true color) 













Figure 6. Color IR EO-1 ALI image of the Arizona swath (left), full-scale subsets of the ALI image (center) and its 

simulation from the EO-1 Hyperion data (right). 


7. DISCUSSION 

Overlap area of the New England images stretches from Boston, Massachusetts, to Rhode Island Sound in 
the Atlantic Ocean (see Figure 5). The coverage includes many urban areas, abundant vegetation (both forests and 
agriculture), and an extensive seawater surface. Overlap areas of the Arizona images cover mainly desert with 
moimtains (minerals) and sparse vegetation (see Figure 6). Therefore, the two images represent quite different 
environments and allow for the band synthesis algorithm testing with various spectral features. Sinface constituents 
of the Arizona images are similar to the ones used in the MODTRAN modeling. Based on the MODTRAN results 
presented above, a very good agreement between the actual and simulated data has been expected for the Arizona 
images. Although such an agreement occxns only for some spectral bands, these results and those from the AVIRIS- 
based simulations fully validate the presented band synthesis method. 
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Figure 7. Histograms of radiance values for the actual EO-1 ALI and Landsat 7 ETM+ image as well as for the 
respective images simulated by spectral band synthesis from the Hyperion hyperspectral data. 





















Differences observed for the other spectral bands do not contradict the band synthesis method, but only 
suggest that radiometric calibration of the sensors needs to be improved. Similar results have been reported by 
others (Jarecke et al., 2001; Barry and Ong, 2001). 

The simulations of the Landsat 7 ETM+ image using AVIRIS data acquired near-coincidently (within 
minutes of each other) from a high-altitude aircraft show that a very satisfactory radiometric agreement can be 
achieved even without applying corrections for effects of atmospheric radiative transfer processes occurring above 
the airplane altitude. However, in most cases the corrections will need to be applied to account for differences in 
viewing geometry, solar illumination, and atmospheric conditions. This becomes especially inportant when data 
from a hyperspectral instrument acquiring images from a low-altitude aircraft are to be used in modeling of satellite 
multispectral sensors. 

8. CONCLUSIONS 

A spectral band synthesis algorithm for simulations of multispectral images from hyperspectral data has 
been formulated and implemented in the Applications Research Toolbox software package. High correlation 
achieved between the simulated images and the data acquired near-coincidentally by actual remote sensing 
instruments has validated the algorithm. Validation has been supported by results of MODTRAN modeling 
conducted with an extensive set of surface reflectance spectra and atmospheric conditions. The modeling has also 
shown that band synthesis may be less accurate, in some cases, due to spectral aliasing. Nevertheless, the band 
synthesis algorithm can be effectively applied in modeling of multispectral sensors in the remote sensing 
applications research and development area. The same algoriflun can be used as well for cross-calibration of 
hyperspectral and multispectral instruments (e.g., EO-1 Hyperion and ALI vs. Landsat 7 ETM+). 
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• Applications Research Toolbox 

• Band synthesis algorithm 

• MODTRAN modeling 

• Images and histograms comparison: 

♦ AVIRIS^ETM+ 

♦ Hyperion ALI 

♦ Hyperion -> ETM+ 

• Conciusions 


Applications Research Toolbox 
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• Systematic studies are needed to achieve a better 
understanding of the multispectral data requirements for remote 
sensing science and applications. 

• Too few multispectral data sources are available to allow for 
parametric studies of the requirements for spatial resolution, 
spectral bands, signal-to-noise ratio, data quantization, and 
band-tO“band registration. 

• Applications Research Toolbox (ART) provides a simulation 
solution to that problem; it uses data acquired by existing 
sensors with higher spatial and spectral resolution to create 
multispectral images with predefined characteristics. 

• Datasets simulated with key data characteristics varied 
parametrically can be evaluated by potential end-users in real- 
world applications. 


ART Process Flow 
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Spectral Band Synthesis 
plays a central role in the 
Applications Research 
Toolbox simulations 


Simulations based on spectral and spatial degradation of 
higher-resolution images acquired with existing remote 
sensing instruments 
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Spectral Band Synthesis Algorithm 
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Spectral response of a multispectral band of the target sensor (MSI: ETM+, ALI) is 
approximated with a linear combination of spectral responses of the hyperspectral 
channels (HSI; AVIRIS, Hyperion) : 




Assuming the hyperspectral channels having Gaussian shape with FWHM of A^ for 7=1,,.., N^j^j 

The set of n equations solved in the least-squares sense to derive coefficients c^- 
The coefficients applied to calculate the synthesized multispectral pixels from the hyperspectral-enes* 
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Band Synthesis Results 
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• The synthesized bands and the actual closely overlap, although some 
artifacts do occur (ripples at band plateaus, shoulders at band edges, and 
negative values outside bands) 

• Multispectral bands that are significantly broader than the hyperspectral 
bands of the input instrument (»10 nm for Hyperion and AVIRIS) are 
modeled more accurately 

• For SWilR l^nds, the synthesized bands are in very good agreement with the 
actuakd?^^ 
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®90729t01p01_rlI.Ia : Line;605, Sample 523 


1999 AVIRIS (color IR) 


Spectra for three 
sample pixels show 
that simulated 
multispectral radiance 
mirrors measured 
hyperspectral radiance. 
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MODTRAN 



• Undertaken to evaluate 
effects of differences 
between actual and 
synthesized bands 

• -30,000 MODTRAN4 
calculations for each 
sensor 

• 1 287 surface reflectance 
spectra from ASTER 
library (JHU, JPL, and 
USGS) and USGS 
Spectroscopy Lab 

• Mainly minerals, but also 
vegetation, soils, and 
man-made materials 
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VIodeling 


6 atmospheric models 

- tropical at 30°N on June 22 

- tropical at 30°N on Dec. 22 

- mid-latitude summer at 45°N on June 22 

- mid-latitude winter at 45°N on Dec. 22 

- sub-arctic summer at 60°N on June 22 

- sub-arctic winter at 60°N on Dec. 22 
each combined with 

• 4 aerosol models 

- rural, VIS = 23 km 

- rural, VIS = 5 km 

- urban, VIS = 5 km 

- tropospheric, VIS = 50 km 

• Nadir geometry from space for all the 
sensors (even AVIRIS) 

- 100-km altitude 

- ground at sea level 

- longitude 0° 

- 10:00 UTC 
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MODTRAN Results: Band 2 (Green) 

Hyperion ~^AU Hyperion ETM+ AViRiS-^ETM+ 
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MODTRAN Results: Band 4 (NIR) 
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Images 


Laurel, Maryland 


Landsat 7 ETM+: path 15 row 33 
2000-05-11 15:38 UTC 
30 m GSD (Level 1G) 


Landsat 7 ETM+ spectral band synthesis 
AVIRIS (ER-2): f000511t01p03_r02 
2000-05-11 15:35 UTC 
~19 m GSD 


True color with square root stretch (histogram matched) 



Maryland Histograms 
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Good agreement despite GSD difference: no significant need for atmospheric correction. 








New England Images 
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• Acquired on May 9, 

2001 at 15:17 UTC 

• WRS path 12, row 31 

• Hyperion and ALI 
images were collected 
simultaneously, one 
minute after the ETM+ 
image was collected 
from the same orbit 

• Overlap area from 
Boston, Massachusetts 
to Rhode Island Sound 
in Atlantic Ocean 

• Radiometric calibration; 
no geometric correction 
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Arizona Images 


Acquired on March 23, 
2001 at 17:42 UTC 

WRS path 35, row 38 

Hyperion and ALi 
images were coliected 
simultaneously, one 
minute after the ETM+ 
image was collected 
from the same orbit 

Mostly desert area; 
mountains (minerals), 
sparse vegetation 

Radiometric calibration; 
no geometric correction 
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Image Histograms: Band 2 (Green) 
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Image Histograms: Band 3 (Red) 
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image Histograms: Bands 4 and 4’ (NIR) 
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Image Histograms: Band 5 (SWIR1) 
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image Histograms: Band 7 (SWIR2) 
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• A spectral band synthesis algorithm for 
simulations of multispectral images from 
hyperspectral data has been formulated and 
implemented. 

• The algorithm has been validated by 
comparison of the simulated images with data 
acquired near-coincidentaliy by actual 
multispectral instruments. 

• The same algorithm allows for cross-calibration 
of hyperspectral and multispectral instruments 
(e.g., EO-1 Hyperion and ALI vs. Landsat 7 
ETM+). 
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